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Given physical systems, counting rule for their statistical mechanical descriptions need 
not be unique, in general. It is shown that this nonuniqueness leads to the existence of 
various canonical ensemble theories, which equally arise from the definite microcanonical 
basis. Thus, the Gibbs theorem for canonical ensemble theory is not universal, and 
maximum entropy principle is to be appropriately modified for each physical context. 
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It is generally believed that canonical ensemble theory arising from the microcanonical 
basis is unique. This conviction seems to have its origins in the demonstration given by 
Gibbs [1]. In this Letter, we show that it is actually not true. A crucial point regarding 
this remarkable fact is that, given a system, rule for counting its physical configurations 
is not unique and is context-dependent, in general. 

A counting rule is an algorithm, which establishes a connection between entropy, a 
macroscopic quantity, and the number of microscopic configurations of the system under 
consideration. The most celebrated rule is that of Boltzmann, who employed the 
logarithmic function for counting the microscopic configurations. A wide class of 
physical systems is covered by this logarithmic counting rule. However, strictly speak- 
ing, there is no a priori reason to assume such a special counting rule to be completely 
universal. In fact, there may yet exist a class of systems which seems to prefer alternate 
kinds of counting rules. Specifically, nonextensive systems, such as systems with long- 
range interactions, long-range memories or (multi)fractal structure, belong to this class. 
In what follows, we first summarize the derivation of ordinary canonical ensemble 
theory from microcanonical basis with the principle of equal a priori probability based on 
the logarithmic counting rule. Then, we present a new counting rule, which leads to a 
non-Gibbsian canonical ensemble, showing the nonuniqueness of canonical ensemble 
theory. 

Consider a system s and take N replicas s v s 2 ,L ,s N of it. S ={ j 'a} a=12L N 1S 

referred to as a supersystem. Let A a be a physical quantity associated with s a and is 
assumed to be bounded from below. It can be thought of as the system energy, for 
example. Its value is denoted by a(m a ), where m a labels the allowed configurations of 

s a . A quantity of interest is given by its average over the supersystem: A a . 

Microcanonical ensemble theory states that the probabilities of finding S in the 
configurations where the values of the macroscopic quantity lies around a certain value a , 
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i.e. 



1 



N 



N 




(1) 



are all equal. Here, £ goes to zero with N — > °° . The ordinary central limit theorem and 

law of large numbers indicate that e ~ o(l/Vlv). However, if the Levy-type power-law 

canonical distribution is in mind, relevant mathematics is the Levy-Gnedenko generalized 
central limit theorem, and accordingly the assumption on the order of N -dependence of 
e should appropriately be modified. 

In Ref. [2], a way of deriving ordinary canonical ensemble theory is presented based 

on the logarithmic counting rule. The probability p(m) of finding the system s = s 1 in 

its mth configuration is given by the ratio of two numbers of equally-probable 
configurations {m,,m 2 ,L ,m N ], i.e. p(m) = W(m)/W . Here, W is the total number 
of configurations satisfying eq. (1), whereas W(m) is determined by the following two 
conditions: a) s l is found in m x =m, and b) a in the condition in eq. (1) is the 
arithmetic mean over the configurations of S . To calculate it explicitiy, we rewrite eq. 
(1) as follows: 
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[a(m)-a] + — Y a(m a ) 



N-l 



(2) 



a 



N 



N 



The number of configurations Y N satisfying 




(3) 



3 



is counted in the large- N limit as follows: 



In 



( N-l 

~N~' 



= ]n[Y N (a)]»^>S(a), 



(4) 



where S(a) is some function of a and will be identified with the entropy. This 
logarithmic counting rule imposes the additional extensivity assumption on the entropy. 
From eqs. (2)-(4), we have 



\nW(m) = \nY N 



(N-l 1 



dS 



a - — [a(m) - a] I = lnY N (a) - [a(m) - a]^~z. (5) 
V N N J da 



Therefore, defining f5 as 



dS(a) 
da 



(6) 



and putting 



Z((5) = lim 



W 



N ^Y N ( a y 



(7) 



we obtain the canonical distribution 



(8) 
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where Z(f5) = Z(f5)&xp(f5a) with the ordinary canonical partition function Z(f5) = 

L„, ex p[~^ a ( m )]- 

In maximum entropy principle [3], the distribution in eq. (8) is derived from the 
Boltzmann-Shannon entropy 

S = -£ p(m)\np(m) (9) 

m 

under the constraints on the normalization of p(m) and the expectation value 

^ p(m)a(m) = a. (10) 

m 

Then, f5 is the Lagrange multiplier associated with this constraint. Note that equation (10) 
is equivalent to the condition 



dZ(fi) 



= 0. (11) 



On the other hand, the entropy in eq. (9) is calculated to be 

5 = lnZ(jS). (12) 

Therefore, equation (11) is actually the maximum entropy condition. Consistency of eq. 
(12) with eq. (4) identifies 
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Z{P) = ]im[Y N (a)]»- 



(13) 



Also, from eq. (7), W is found to be 



W = lim [Y N (a)] 



l+i 

N 



(14) 



In the above derivation, the logarithmic counting in eq. (4) plays an essential role. 
Now, let us examine another kind of counting rule. Specifically, we examine to replace 
eq. (4) by 



In. 



r N-l 



= ln q [Y N (a)]»^S q (a). 



(15) 



Here, ln 9 x is the "g -logarithm" defined by 



ln q x = —(x^-l), 
l-a 



(16) 



which is the inverse function of the "^-exponential" 



e,W = ' 



, '"9 



[l + (l-q)x] (l + (l-<7)*>0) 



(otherwise), 



(17) 



where q is a positive parameter. In the limit q—>l, In x and e Ax) converge to the 
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ordinary \nx and e x , respectively. As the ordinary logarithm, \n q x is also a mono- 
tonically increasing function of x. S q (a) in eq. (15) is a certain quantity dependent on 

a and will be shown to be the Tsallis nonextensive entropy [4]. Instead of eq. (5), now 
our algorithm is given as follows: 



( N-l_ 1 _ ^ 

In W(m) = In Y N a fa(m)-al 

« q \ N N l V 



= In, Y N {a) -Ua{m) - a]^-\n q Y N (a) , (18) 
N da 



provided that iV may be large but finite. Defining 



-^r L = P (19) 
da 



and using eq. (15), we have 



/^[rf-'^P. (20) 
Jy da 



Therefore, we find 



^lnJ N (a) = (3N[Y N (a)] {1 < 1 -^. (21) 
da 



Substituting eq. (21) into eq. (18), we have 
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In, W(m) - \n q Y N (a) = -P[Y N (a)] [a(m) - a] . 



(22) 



Taking advantage of the relation 



In 



(23) 



we obtain 



(24) 



where 



(25) 



with 
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w =l + (l-«)S,(a). 



(26) 



From eq. (24) and the total number of configurations W = W(m) , we construct 



W 



I N\ U ) m 



(27) 



Consequently, we find the probability p Am) = W(m) / W to be 



P^) = jj^e v (-p t [a(m)-a]). (28) 



The property corresponding to eq. (11) here translates to 



= 0, (29) 



leading to the result 



«=<A>=J> ? (m)a(m), (30) 



where P q (m) is the escort distribution [5] 



\p a ( m )X 



Equation (30) shows that the arithmetic mean is identical with the normalized q- 
expectation value introduced in Ref . [6] . 

Now, we show that consistency of the whole discussion is achieved if the generalized 
entropy is given by 

S q = ln q Z q ((3), (32) 



which should be compared with eq. (12). Accordingly, equation (29) becomes the 
maximum generalized entropy condition. Consistency between eqs. (32) and (15) leads to 
the identification 

Z q {P) = [Y N (a)]i (33) 
as in eq. (13). Furthermore, from eq. (27), W is seen to be 

W = [Y N (a)V + \ (34) 

which is formally similar to eq. (14). 
Now, note that the identical relation 

Ek0n)]'=[z f (j8)p (35) 

m 

holds for the distribution in eq. (28) with eq. (30). Combining this with eq. (33), we 
have 

[Ua)P = Y J [ Pq {m)\ q ■ 06) 

m 

Therefore, c in eq. (26) is found to be 

'•=E (37) 
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Finally, using eqs. (33), (36) and (37), we ascertain that both eqs. (26) and (32) 
consistently lead to 



which is precisely the Tsallis entropy [4] . 

In the limit q->l, eqs. (28), (30) and (38) converge to eqs. (8), (10) and (9), 
respectively. 

We end our discussion with emphasizing the following points. p q (m) in eq. (28) is 

the generalized canonical distribution in nonextensive statistical mechanics [6], which is 
derived via the maximum entropy principle based on the Tsallis entropy in eq. (38) sub- 
ject to the constraints on the normalization of p(m) and the normalized ^-expectation 
value of A given in eq. (30) and is known to lead to the consistent thermodynamic 
formalism. f5 in eq. (19) is the Lagrange multiplier associated with eq. (30). Another 
important point is that if the limit N — > °° is strictly taken, for example, in eq. (27), then 

the difference between Z(f3) in eq. (7) and Z q {f5) in eq. (27) may disappear. In other 
words, q seems to go to unity in the limit /V— ><>o. This suggests that nonuniqueness 
of counting rules may be intimately related to the fact that physically /V is large but 
actually finite. Such an observation is consistent with the discussion developed in Refs. 
[7,8]. This leads to a fundamental question regarding a connection between the concepts 
of extensivity and thermodynamic limit. These considerations, in turn, indicate that 
nonextensive statistical mechanics would also be important for understanding 
thermodynamic properties of small systems. 

In conclusion, we have found that canonical ensemble theory arising from the 




(38) 
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conventional microcanonical basis with the principle of equal a priori probability is not 
unique. We have shown the nonuniqueness by employing a non-logarithmic counting 
rule, the g -logarithmic counting, as an example. We have found that, in this case, the 
resulting canonical ensemble theory is Tsallis' nonextensive formalism. We stress that the 
concept of the arithmetic mean is the same throughout the discussion: the nonuniqueness 
is brought about through counting rule and concomitant definition of the statistical 
expectation value. We wish to mention that the same result is obtained by using the 
method of steepest descents [9] and the Levy-Gnedenko generalized central limit theorem 
[10]. 
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